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SUMMARY 


An optimal control theory is presented that accounts for stochastic and 
variable time sampling in a distributed microprocessor-based flight control 
system. The theory is developed by using a linear process model for the air- 
plane dynamics where the information distribution process is modeled as a 
variable time increment process for which, at the time that information is 
supplied to the control effectors, the control effectors know the time of the 
next information update only in a stochastic sense. A stochastic optimal con- 
trol problem is formulated and solved for the control law that minimizes the 
expected value of a quadratic cost function. An example is presented where the 
theory is applied to the control system design of the longitudinal motions of 
the P-8 DFBW (digital fly-by-wire) airplane. Simulation results were generated 
by using a Monte Carlo simulation in which one of three possible sample times 
was selected with a Markov process for each sample time interval. For each 
sample, the control system did not know what the sample time was at the start 
of the sample time interval. Theoretical and simulation results indicate that, 
for the example problem, the optimal cost obtained by using a variable time 
increment Markov information update process in the control system is almost 
identical to that obtained with a known and uniform information update interval 


INTRODUCTION 

The availability of microprocessors, assembled from a small set of large- 
scale integration (LSI) logic, has presented the control system designer with 
new opportunities for sophisticated control system design. Many designers of 
control system components have improved their products through the use of micro 
processors. This fact is substantiated in reference 1, where a design of a 
microprocessor-controlled rate gyro is presented. The use of microprocessors 
in the rate gyro resulted in an improved performance and a substantial savings 
in hardware. The trend of device manufacturers to use microprocessors as 
integral parts of their equipment is expected to continue. The features of a 
microprocessor - flexibility, modularity, good hardware communications, and 
low cost - have made distributed control a suitable answer to many control 
problems . 

The following sketch shows an example of a distributed flight control 
system with minimal module requirements from the airplane flight control point 
of view: 




Note that a microcomputer control unit (cu) is associated with each physical 
device in the system and that each controller can communicate with the other 
physically distributed elements by using an information exchange bus. 

Operating systems for distributed flight control systems will necessarily be 
complex and will employ various techniques for reducing data flow in the 
information exchange buses and for ordering of tasks. The need for reducing 
the data flow is dictated by the finite bandwidth of the information exchange 
bus whereas the need for task ordering is dictated by the finite computational 
resources of the system and by reorganization requirements to accommodate 
component failures. This paper addresses one aspect of the data flow problem - 
specifically, the case where sensor components obtain an estimate of the state 
of the airplane and transmit the estimate to the airplane flight control 
effectors by using the information exchange bus. It is assumed that data com- 
pression techniques are used to reduce the bus traffic and that the state is 
updated to the control effectors only when required to maintain adequate perfor- 
mance of the system. Thus, there will be variable time intervals between infor- 
mation updates to the control effectors. Accounting for the variability in the 
information update time intervals is an important consideration in the design 
of the logic of the controllers for the flight control effectors. This paper 
presents a theory for accomplishing this based on a stochastic modeling of the 
information update process. 

In spite of the fact that the optimal control theory of sampled data 
stochastic linear system has advanced rapidly since some of the early contri- 
butions (refs. 2 and 3), nearly all results have been obtained under the 
assumption of the existence of a centralized decision maker which takes all the 
measurements and generates all control inputs. For systems with multiple 
decision makers, a general computationally feasible theory does not exist at 
the present time. Information exchange is a critical issue in a distributed- 
control system where no controller, local or central, possesses a complete 
description of the system. The controllers, therefore, must exchange informa- 
tion among themselves in order to achieve satisfactory operation. 
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The type of information available to a controller for its decision making 
is called its information pattern (ref. 4) . For a distributed processing 
system, information patterns differ considerably from those of a centralized 
control system in which the central controller is assumed to have complete and 
instantaneous information of the system. Because of its decentralized nature, 
a distributed control system may have a stochastic information pattern where 
the data are sampled at random times. Modern control theory has only a limited 
amount of available work on this practical aspect of control problems, the past 
emphasis being on single rate control and filter problems which are well 
developed (refs. 3 and 5) • It has been assumed that the information pattern 
is deterministic and control systems with stochastic information patterns have 
received little attention. Accordingly, the primary emphasis of this report 
is the stochastic nature of the sampling process. In this research, a stochas- 
tic model of a sampling process is developed which accounts for (1) variable 
time intervals in sampling systems; (2) uncertainty of data arrival time in 
multiplexed communication systems; and (3) multirate sampling systems. The 
first suggestion of stochastic sampling is believed to be reference 6 where an 
optimal control policy was obtained for a system with a discrete Markov sampling 
process. However, the optimal solution was restricted to a process in which 
the time interval between each information update was known to the system at 
the initiation of the interval. In the present report, an optimal policy is 
obtained for virtually all Markov sampling processes. The restriction is 
further relaxed to include the situation where the control unit does not have 
to know the duration of the information update interval at its initiation. 
Instead, the control unit only has knowledge of the past history of the infor- 
mation update intervals. The assumption is more applicable to a distributed 
control system because its control units ordinarily will not know how long they 
will have to act with the same information. 

As an example, the theory is applied to the control of the longitudinal 
motion of the F-8 DFBW (F-8 digital fly-by-wire) airplane. Both theoretical 
and simulation results indicate that, for the application example, the optimal 
cost obtained by using a variable time increment Markov information update 
process (where the controller knows only the past information update intervals 
and Markov transition mechanism) is almost identical to the cost obtained by 
using a known uniform update interval. This result is significant because in 
the stochastic sampling case the sampling process is known only in the stochas- 
tic sense; that is, at any instant the system controller does not know the time 
of the next sample, only its statistics. The expected performance of the system 
is, however, nearly the same as that of an optimally designed system that has 
uniform and known sampling. 


SYMBOLS 

A n X n matrix used to represent airplane dynamics 

B n X m matrix used to represent influence of airplane controls on air- 

plane dynamics 

E expectation operator 
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arbitrary function 
identity matrix 
cost function 
gain matrix 

index indicating information update interval 

number of admissible information update intervals 

indices indicating information update intervals 

index indicating last interval of an N-stage process 

number of occurrences of sample time s^ in simulation 

n X n matrix which is sensitivity of cost J to initial condition 
variations 

probability density function 

n X n matrix weighting state in cost function J 
pitch rate 

m X m matrix weighting control in cost function 

n X n matrix weighting terminal value of state in cost function J 

element in space of update intervals which is discrete, finite, and 
stationary 

transition matrix for stationary Markov process 

element of ^k^ ^ ^ ^k 

time 

element of Tj^ 

m-dimensional control column vector 
airspeed 

m-dimensional control column vector after transformation 
n X m matrix weighting x,u cross-product term in cost function J 


n-dimensional state vector 



a cingle of attack 

r control input matrix in difference equation representation of airplane 

dyneunics 

Y,6 dummy variables of integration 

6e elevator deflection 

flap deflection 
6 pitch angle 

time at which ith information update takes place 

Tjj space of admissible information update intervals at 

T|^ set of k time interval sequences which are admissible for k-stage 

process, that is, the Cartesian product x T 2 . x 

(j) state transition matrix in difference equation representation of airplane 

dynamics 

Subscripts: 

i,j,k indices indicating information update interval 

N last stage of N stage process 

Tk|Tk_i space of admissible k sample intervals conditioned on the 
process 

T|^ operation to be performed over space of information update process 

0 initial value 

A dot over a symbol indicates differentiation with respect to time. The 
superscript T indicates transpose of the matrix. 

MODELING OF RANDOMLY SAMPLED SYSTEMS 

The purpose of this section is to present a model which is useful in 
describing the stochastic information transfer process in a multiple-processor 
control system. Consider the continuous time invariant dynamical system repre- 
sented by the linear differential equation 

X = Ax + Bu (1 ) 

where x is an n-dimensional vector representing the system states, u is 
m-dimensional vector representing the control inputs, A is em n x n matrix 
describing the dynamics of the system, and B is em n x m matrix describing 
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the control effectiveness. The state information is assumed to be updated in 
the controller at discrete points in time o^. The sequence is defined 

as the sum of a stochastic process tj^ in the following sense 


k 

gk = ^0 + y. ^i 

i=l 


where tj^ is an element of the set which is the set of admissible sample 

time intervals. Referring to the sketch on the right, which illustrates the 
stochastic sampling nomenclature 
that is followed throughout this 
report, one finds that Cq 
denotes the starting time, t)^ 
denotes the kth time interval 
between two consecutive infor- 
mation updates, and is the 

time that the kth information 
update takes place. Since the 
time interval between two con- 
secutive information updates 
cannot be negative, the sample space of the stochastic process for 

i = 1, 2, . . ., N is restricted to sets of positive real numbers. There is, 
however, no restriction on the statistical nature of the process. The set Tj^ 
of information update sequences Tj^ which are admissible for a k-stage process 
is the Cartesian product of t^, that is. 


STATE, 

X 




VA- 


°2 etc, Ok-1 °k 
Time, o 


—j 

M.-H 

i-J — i — //£ L 


"N 






tk ^ "^k 


Tk = t] , . . . f t)5 


The average of a quadratic integral in the state and control is defined 
to be the cost functional for the N- interval process to achieve the desired 
system performance. A cost functional is assumed in the following form: 




xT(t) Q x(t) + uT(t) R 


u(t)J dt + xT(o^) s x(ajj^ 


(3) 


The cost functional can be expressed as the sum of N integrals by divid- 
ing the total time into N intervals, namely. 
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If control inputs are further restricted to piecewise constant functions of 
time that change only at sampling instants 0)^, that is, given the sequence 
Uj^, )c^1, 2, • • afN, then 




*^0 


(|)T(y) q 4>(y) 

[r + rT(Y) Q 

(j)T(Y) Q r(Y) 


dY + W^R-lwjJ 
r(Y)] dY 
dY 
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Equations (6) were obtained by using the techniques of reference 7 with the 
transformation 


V. = u. + r"V^x. (7) 

k k k k k ' ' 

T 

employed to eliminate the cross-product terms Xj^Wj^Uj^ that would otherwise 
appear in the cost function representation. 


OPTIMAL CONTROL OF RANDOMLY SAMPLED SYSTEMS 


The main results on optimal control of randomly sampled systems can be 
summarized in the following theorem. 


Theorem 1 ; For an N-stage stochastic process model described in equa- 
tions (6), the sequence V]^ (eq. (7)) which minimizes J given that the 
distribution of the stochastic process {t^,} is governed by the following 
recursive relations: 

T 

'^N-k,N ” 


^”^N-k+1 I^^N-k ^-k^-k*Sl-k [^N-k ^N-k^-^ ^k-1 j^N-k ‘‘‘ ^ 

' Vk+ll^N-k Vk] 


where for notational simplification equations (8) have been written as 
Pk = ^k|T^_k %-k = %-k|TN_k* proof, see the appendix. 


Markov Process Assumption 

The statistical property characterizing a Markov process is that the 
present state of the system contains all relevant statistics pertaining to the 
future. Mathematically, a process x^ , X2f . . . is called a Markov chain if 

P^Xn+i|xi, X2, . . ., xtj'j = P^Xn+ 1 |xuj (9) 

If Tk = {ti . . . t^} with Tk as its sample space and if Xk is the 
sample space of tkf then, assuming a Markov chain. 
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( 10 ) 


This equation states that the present sampling interval determines the proba- 
bility of the next sampling interval in the future. For such a process, a 
transition mechanism can be defined and the a priori joint density pp (Tj^) 
can be written as k 

" i!i '’■'ll ^1-1 

Hence, for a Markov process, specification of the a priori density function 
Pi- (^n) together with the transition probabilities p_ ft. I t, \ 

^0 ^ krk-lV 

completely determines the distribution of the process. As a result, 
equations (8) can be modified to replace conditioning on by conditioning 

on T^-k. 


Theorem 2 ; The probabilistic Riccati equations with Markov assumption are 

■^N-k,N " 


P 


k 




+ 


Vk^»-kVk [Vk ^k-i[Vi 



Vk 



+ r 


T 

N-k 


P 


k-1 




k-1 



where P, ^ P. , ^ 

" "IVi 


*H-k - Vk| 


The computation of a solution to these probabilistic Riccati equations 
is simpler than that for equations (8) because the stochastic process is more 
restricted. However, if the process is dependent on time and if the sample 
space of continuous, integration still has to be performed at each 

stage of the^recursive Riccati equation. The computational time for the Markov 
case can be exhorbitant. On the other hand, if the process is stationary 
(independent of time) and the sample space of continuous, integration 

for the expectation operator has to be performed only once before solving the 
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probabilistic Riccati equations. A simpler case in which the process is sta- 
tionary and the sample space is discrete is discussed next. 


Discrete Stationary Markov Processes 

If the sample space t. is discrete and finite and if the conditional 
probability is stationary, uien the transition mechanism can be represented 
by the matrix 

for a given sample space Tj^ = {s^, S2, . . ., sjj} for k = 1 , 2, . . ., N. 
In that case, the optimal solution consists of M gain sensitivity matrices 
at each stage so that 



Also, the expectation operators can be replaced by finite summations such as 



M 

■ i: 




where f is an arbitrary function. 

For simplification, the following notation is used: 




l-k,i ®^^N-k~®i^ ®i 


^-k,i 

‘*’N-k,i 

^N-k,i 





(i = l, 2, . . , M) 


where Q^, Rf, 4>i, and are defined in equations (6) . The probabilistic 

equations can now be written in difference equation form. 
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Theorem 3 ; The recursive relations for discrete stationary Markov processes 


are 






^ ^-k| j\-k,j*Sj-k| j ■*’ ‘^^N-ko ^N-k,j^-k|^ ^k-l,j *1 


**N-k,j ^ ^N-k,j^-k)j 




Vkli “ ■'i|j[^-k,j ^ ^N-k,jVlljVko^^ '^i|i»pl^k,nVl|mVk,n]j' 


The recursive computations required to generate the optimal control for 
these probabilistic Riccati equations are similar to that for a deterministic 
Riccati equation. However ^ the probabilistic Riccati equation also requires 
the prior distribution function for tQ, namely Pj^Ctp)/ to initiate the 
computation. Furthermore, at each stage of the recursive computation, M gain 
matrices and M sensitivity matrices must be calculated. The computations 
required to generate the optimal control sequences for the randomly sampled 
system is equivalent to solving M Riccati equations coupled by transition 
probabilities. If the transition probability matrix is an identity matrix, 
then the corresponding Riccati equations are decoupled. This case corresponds 
to uniform sampling with probability one with the sampled time determined by 
the first sample. Each decoupled probabilistic Riccati equation reduces to a 
deterministic Riccati equation with uniform sampling. The solution with N 
and k infinite is called the quasi-steady-state solution. The quasi-steady- 
state solution is obtained as the M gain matrices approach constant values. 

In general, the M gain matrices have different quasi-steady-state values. For 
the purpose of computing quasi-steady-state gains, the a priori distribution 
function can be chosen to be 



This is equivalent to selecting an initial sampling interval tQ = to start 
the process. Hence, there are generally M simulations of interest in the 
class of distributions considered, one for each element of the discrete sample 
space Tg. The optimal cost is not generally asymptotically stationary; that 
is, the cost depends on the initial sampling interval chosen, for example, 
the case where T = I, because all subsequent sampling intervals are the same 
as the initial sampling interval. Each simulation requires that the initial 
conditions x(0) and the initial sample interval tg contained in 
T = {s-| , . . ., sjj} be given. If the quasi-steady-state gains are used and 
if tg = S£, then the control u(Cg) applied over the interval (ag,a-i) of 
unknown and stochastic duration t-| is given by u(ao) - Kix(ao), where 
Ki = as N and k become infinite with i = 1, 2, . . ., M. Sub- 

sequent control actions are computed according to Uj^ = K^xj^ if tj^_^ = s^. 
Figure 7 is a flow chart of the closed-loop control logic using quasi-steady- 
state feedback. The next section illustrates the application of the quasi- 
steady-state theory to flight control system design. 


EXAMPLE APPLICATION OP OPTIMAL STOCHASTIC REGULATOR TO AIRPLANE 

The theory developed in the previous section has been applied to the design 
of a control system for the longitudinal control of the F-8 DPBW airplane. The 
function of the control system is to produce elevator and flap commands to keep 
the airplane in steady level flight in the presence of disturbances. A four- 
dimensional model is used to design and evaluate the control system. It is 
obtained from linearizing the longitudinal equations of motion of the airplane 
about the equilibrium flight condition at an altitude of 6100 m (20 000 ft) and 
a 0.67 Mach number. The state vector is defined as x^ = (V,ot,q,0) and the 
control vector is u"^ = Using these definitions, the equation of 

motion of the airplane takes the form of equation (1 ) where the A and B matrices 
are shown in table I. 

Figure 2 shows the unaugmented response of the airplane to initial con- 
ditions. The motion is characterized by two oscillatory modes, one of short- 
period oscillation and the other a long period called the phugoid. For this 
example, the weighting matrices Q and R have been selected so that only 
elevator deflections are used to control the short-period mode and so that only 
the short-period mode is regulated. This leads to high weights on the a and 
q error terms and high weights on the flap weight term. The V and 9 
weighting terms were small so as not to overcontrol the long-period mode. The 
specific values of Q and R for this example are Q = Diag (0.25, 3.0, 3.0, 
0.001) and R = Diag (4.0, 0.4). The sample space t was taken to be 
T = {0.02, 0.03, 0.1 } and the transition mechanism was 
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Hence, if the sampling intervals at t|^_i is s*; the probability that tj^ = s*| 
is 0.95, the probability that t)^ = S 2 is 0.05, and the probability that 
" ®3 zero. Figure 3 is a graphical representation of the transition 
mechanism. The characteristic of this transition mechanism is that it leads to 
a process that is cyclic; that is, it tends to change gradually from the fastest 
sampling interval to the slowest and back to the fastest. 

For the example, the stochastic Ricatti equations (eqs. (11)) have been 
solved iteratively to obtain the quasi-steady-state gains and sensitivity 
matrices shown in table I. The optimal stochastic closed-loop system has been 
simulated using stochastic sequences. Figure 4 shows the response of the 
system using the optimal stochastic closed-loop control system corresponding 
to the flow chart of figure 1. For comparison, the optimal deterministic 
solution for a known information update interval s^ =0.02 sec has also been 
simulated. The solution corresponding to the deterministic and known update 
interval was obtained by using a transition matrix T = I in equations (11). 
Figure 5 shows the response of the system using optimal uniform update 
intervals. The trajectories differ insignificantly; this indicates that little 
is lost in the stochastic information update process provided the stochastic 
nature of the process is accounted for in the actuation logic. The expected 
value of the cost of the process can, of course, be evaluated with the sensi- 

T 

tivity matrices according to the formula ^o^ooji ^0* value is 0.5097 for 

uniform sampling and 0,5160 for stochastic sampling assuming tg = S] = 0.02 
with the same initial conditions used in figures 2, 4, and 5. For comparison 
the cost during a 10-sec simulation with no control input using the same initial 
conditions is 1,427. To study the stochastic behavior of the cost, 50 Monte 
Carlo simulations were performed for the optimal feedback system and each non- 
optimal feedback system. Table II summarizes the statistics of the simulations. 
The ij element of the table is the number of transitions from s^ to Sj 
divided by the total number of s^-intervals in the 50 simulations N^. Compare 
the T-matrix with the entries of table II. The agreement is best for the first 
row (corresponding to s^; ) because s-| is the most frequent interval used in 
the 50 simulations. The optimization results are summarized in table III. They 
are consistent with the theory; that is, in the randomly sampled system, the 
optimal stochastic gains give the lowest average cost (0.5174) over all other 
gains including those calculated for the uniformly sampled system. 


CONCLUDING REMARKS 

In this paper the problem of accounting for variability in information 
update time intervals to actuator type control units for microprocessor-based 
flight control systems has been addressed. The problem was cast as a stochastic 
sampling regulator wherein the information update process was random. In this 
way variable sample time systems are treated as a stochastic regulator problem. 
The optimal control policy was shown to satisfy a stochastic Ricatti equation. 
Its use has been illustrated for the control of the longitudinal motions of the 
F-8 DFBW airplane. For the 50 Monte Carlo simulations conducted, the perfor- 
mance of the system using a stochastic information update process was very close 
to that obtained by using a Kalman regulator designed for and using the 
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deterministic and shortest sample time in the admissible set of the stochastic 
case. This conclusion is supported both by theoretical computations using the 
cost sensitivity matrices emd by simulations. 


Langley Research Center 

National Aeronautics emd Space Administration 
Hampton, VA 23665 
September 12, 1980 
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APPENDIX 


STOCHASTIC OPTIMIZATION - PROOF OP THEOREM 1 

The proof of theorem 1 will be inductive following the method of 
reference 2 using dynamic programming. Consider the problem of select- 
ing the sequence Vj^ to optimize J if the distributions of the stochastic 
process {tj^} are given. First a single-stage optimization over the interval 
t e (cTjj-tjg,aiq) is considered and then the result to all N stages is gen- 
eralized. The following sketch may assist the reader in understanding the 
relationships of the sequences vj^, t;^, for the N-stage optimization 

problem; the sequences of the sketch correspond to equations (6) and (7) 
where J = Jq,n* 


state, X 


Control, V 



Cost, J 



Time , a 


single-stage Process 


Referring to the system described by equations (6) and (7 ) , consider the 
last stage of the process which makes a transition from djj_i to Ojj with an 
interval tjj. The optimal control of the stage produces a cost 


'^N-1 ,N 


1 min 


2 V. 


E. 


N-1 


nI 


r^, Vi * ''LiViV 


+ 


T 
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APPENDIX 


v^ere Pq 4 S. The control vu_-i is statistically independent of the 
tij-process. The minimum of Jn- 1 ,N with respect to vn_i is obtained by 

N 

setting -w ^ = 0. Thus, since xjg_i is also statistically independent 

N-1 

of the tij-process, 

SO that 


Vi = - \ 


Hence, vn-i = Kn -1 where the gain %_i |Tj,_i is 

The cost resulting from application of the optimal control can be evaluated as 

Vi,N ' \ ViViVi ^ >^0*1)1 

’ ^ \|Vi Vi * (Vi Vi)’' ®N-I Vi Vi 


where for notational simplification K., , 4 IC, , i™, 
the form N-1 


Hence the cost takes 


^N-l ,N,“ 2 ^-1^1*N-1 


where 


a P, 
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k-Stage Process 

The final two intervals of the process have an optimal cost of 


_ 1 min 
N-2,N 2 




N“1 




T 

"k'^k^'k ■ ’k*'k'k 

k=N-2 


V2,N = I " ''n-2V2''n- 


+ E. 


T X T 

Nr N-1 N-2 


VlVlVl * ''n-iViVi + ’^O-N 


_ 1 min r r~T _ . T „ ~1^ 

N-2,N = 2 Vj,_2 l^Vl|V2 L^-2®N-2V2 V2V2V2jj 


c, Kiv. 


-1 * ’S-l VlVl * -n'o-n 




The later equation follows from the property of distributions 

^N-l I \-2 ^^N I ^N-1 '^N-2 ^N-1 | ^N-2 

^^nI^N-1 ^’'^N-1 Fn-2 


from which 


K T IT IT [^T IT 

Vi I \-2 N-1 I V 2 |_ N r N-1 J 


Hence , 


N-2,N 


1 min fl (~T„ .T_ ,T„ 

^ V2 V Vl|V 2 [^- 2 ®N- 2 V 2 * V2V2V2 Vl^lVl 


APPENDIX 


with the last equation an analogy can be drawn with the single-stage process 
and immediately the conclusion is that 

T 

■^N-2,N “ *N-2^2*N-2 



where P 2 ^ P2|Tn-2 *S«-2 "" ^-2|Tn- 2* ^ k-stage process, mathe- 

matical induction leads to equations (8) and completes the proof of theorem 1 . 
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Table !• - SYSTEM MATRICES AND SOLUTION MATRICES 


i 





~9.529E-3 

-1 . 283E+1 

0 

-3.21 7E+1 


-6.554E+0 

0 




-1 .175E-4 

-9.782E-1 

1 

0 


-2.253E-1 

-1 .513E-1 



A = 





B = 






3.324E-7 

-4.723E+0 

-4.729E-1 

0 


-1 .539E+0 

-1 . 333E+1 




_ 0 

0 

1 

0 _ 


_p 0 

0 _ 















1 .1 97E-4 

1 . 1 08E-3 

-2.454E-4 

-9.406E-3 


1 .922E-4 

-5.379E-3 




1 J08E-3 

1 .432E+0 

1 .804E-3 

-4.01 IE-1 


1 .888E-2 

3.046E-1 

1 

^OO 1 

s 








; 

1 

1 


-2.454E-4 

1 .804E-3 

8.501E-2 

4.311E-2 

~|si 

2.227E-2 

1 .941E+0 




-9.406E-3 

-4.01 IE-1 

4.31 IE-2 
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TABLE II.- RELATIVE FREQUENCY OF TRANSITIONS FOR 
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TABLE III.- RESULTS OF MONTE CARLO SIMULATIONS 
[jO random runs of 1 0-sec duratlo^ 


Gain 

Average 

cost 

Optimal gain for 0.02-sec 

uniformly sampled system . . . 

0.61 58 

Optimal gain for 0.03-sec 

uniformly sampled system . . . 

0.5526 

Optimal gain for 0.10-sec 

uniformly sampled system . . . 

0.5372 

Unaugmented system 

1 .427 

Optimal stochastic gains .... 

0.5174 



Figure 1 Closed-lcx)p system using quasi-steady-state feedback. 
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Figure 2.- Unaugmented response of airplane 
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Figure 3.- Probabilistic transition graph. 


24 





Time, sec 


Figure 4.- Response of randomly sampled system using 
optimal stochastic gains. 






1. Report No. 2. Government Accession No. 

NASA TP-1743 

3. Recipient's Catalog No. 

4. Title and Subtitle 

OPTIMAL REGULATION IN SYSTEMS WITO STOCHASTIC 
TIME SAMPLING 

5. Report Date 

November 1 980 

6. Performing Organization Code 

506-53-63-04 

7. Author(s) 

Raymond C. Montgomery and Peter S. Lee 

8. Performing Organization Report No. 

L-13507 

10. Work Unit No. 

9. Performing Organization Name and Address 

NASA Langley Research Center 
Hampton, VA 23665 

11. Contract or Grant No. 

13. Type of Report and Period Covered 

Technical Paper 

12. Sponsoring Agency Name and Address 

National Aeronautics and Space Administration 
Washington, DC 20546 

14. Sponsoring Agency Code 


15. Supplementary Notes 

Raymond C. Montgomery; Langley Research Center. 

Peter S. Lee: NRC-NASA Resident Research Associate, now at Charles Stark Draper 

Laboratories, Cambridge, Massachusetts. 


16. Abstract 


An optimal control theory is presented that accounts for stochastic and variable 
time sampling in a distributed microprocessor-based flight control system. The 
theory is developed by using a linear process model for the airplane dynamics and 
the information distribution process is modeled as a variable time increment process 
where, at the time that information is supplied to the control effectors, the 
control effectors know the time of the next information update only in a stochastic 
sense. An optimal control problem is formulated and solved for the control law 
that minimizes the expected value of a quadratic cost function. An example is 
presented where the theory is applied to the control of the longitudinal motions 
of the F-8 DFBW airplane. Theoretical and simulation results indicate that, for 
the example problem, the optimal cost obtained with a variable time increment 
Markov information update process where the control effectors know only the past 
information update intervals and the Markov transition mechanism is almost identical 
to that obtained with a known and uniform information update interval. 


1 7. Key Words (Suggested by Author(s) ) 

Optimal control 
Scunpled data 
Stochastic control 
Nonuniform sampling 


18. Distribution Statement 

Unclassified - Unlimited 


Subject Category 66 


19. Security Classif. (of this report) 

20. Security Classif. (of this page) 

21. No. of Pages 

22. Price 

Unclassified 

Unclassified 

26 

AOS 


For sale by the National Technical Information Service, Springfield, Virginia 22161 


NASA-Langley, 1980 



THIRD-CLASS BULK RATE 


National Aeronautics and 
Space Administration 

Washington, D.C. 

20546 

Official Business 

Penalty for Private Use, $300 


Postage and Fees Paid 
National Aeronautics and 
Space Administration 
NASA-451 



^ 1 1U/G/ 111780 S00903DS 

DEPT OF THE AI8 FOBCE 
AF WEAPONS LABOEATOfiy 
ATTN: TECHNICAL LIBSABY (SUL) 
KIRTLAND AFB NM 87117 






POSTMASTER: 


If Undeliverable (Section 158 
Postal Manual) Do Not Return 




